Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | Go Back
View Post [edit]

Poster: hollands Date: Nov 7, 2008 3:53am
Forum: faqs Subject: Robots.txt

For my website www.succubi.nl I made and uploaded a robots.txt file
how long does it take before my website is no longer in the archive?

Reply to this post
Reply [edit]

Poster: hollands Date: Nov 7, 2008 7:26am
Forum: faqs Subject: Re: Robots.txt

force re-index?
I uploaded my index allso
is that what you mean?

Reply to this post
Reply [edit]

Poster: kustota Date: Nov 7, 2008 8:17am
Forum: faqs Subject: Re: Robots.txt

no, you need to enter your site's URL into that form ('archive it') so it will be queued for crawling and will be removed from web archive as a result.

Reply to this post
Reply [edit]

Poster: hollands Date: Nov 7, 2008 11:57am
Forum: faqs Subject: Re: Robots.txt

thanks
done!!

Reply to this post
Reply [edit]

Poster: kustota Date: Nov 7, 2008 5:32am
Forum: faqs Subject: Re: Robots.txt

if you force-reindex your site (http://www.archive.org/web/web.php, in the 'archive that!' section, the archived version should go away within one day.

Reply to this post
Reply [edit]

Poster: hollands Date: Nov 11, 2008 2:13am
Forum: faqs Subject: Re: Robots.txt

and still my site is not removed

can somebody please do something